Detecting synchrony in degraded audio-visual streams
نویسندگان
چکیده
منابع مشابه
Detecting audio-visual synchrony using deep neural networks
In this paper, we address the problem of automatically detecting whether the audio and visual speech modalities in frontal pose videos are synchronous or not. This is of interest in a wide range of applications, for example spoof detection in biometrics, lip-syncing, speaker detection and diarization in multi-subject videos, and video data quality assurance. In our adopted approach, we investig...
متن کاملAudio–visual interaction in visual motion detection: Synchrony versus Asynchrony
OBJECTIVE Detection and identification of moving targets is of paramount importance in everyday life, even if it is not widely tested in optometric practice, mostly for technical reasons. There are clear indications in the literature that in perception of moving targets, vision and hearing interact, for example in noisy surrounds and in understanding speech. The main aim of visual perception, t...
متن کاملMeasuring Audio and Visual Speech Synchrony: Methods
Speech is a means of communication that is intrinsically bimodal: the audio signal originates from the dynamics of the articulators. This paper reviews recent works in the field of audiovisual speech and more specifically on techniques developed to measure the level of correspondence between audio and visual speech. It overviews the most common audio and visual speech front-end processing, tran...
متن کاملDetecting Local Audio-visual Synchrony in Monologues Utilizing Vocal Pitch and Facial Landmark Trajectories
Steven Cadavid1 [email protected] Mohamed Abdel-Mottaleb1 [email protected] Daniel S. Messinger2 [email protected] Mohammad H. Mahoor3 [email protected] Lorraine E. Bahrick4 [email protected] 1 University of Miami Department of Electrical and Computer Engineering 2 University of Miami Department of Electrical and Computer Engineering 3 University of Denver Department of Electrical and Comput...
متن کاملInfant perception of audio-visual speech synchrony.
Three experiments investigated perception of audio-visual (A-V) speech synchrony in 4- to 10-month-old infants. Experiments 1 and 2 used a convergent-operations approach by habituating infants to an audiovisually synchronous syllable (Experiment 1) and then testing for detection of increasing degrees of A-V asynchrony (366, 500, and 666 ms) or by habituating infants to a detectably asynchronous...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Vision
سال: 2011
ISSN: 1534-7362
DOI: 10.1167/11.11.800